Camera-based accessory classification

ABSTRACT

A method for using an accessory with a mobile device is disclosed. The method includes: causing at least one camera of the mobile device to capture one or more images of a pattern on an accessory that is being used with the mobile device; determining a type associated with the accessory based on the one or more images; and entering an accessory-specific operating mode in which behavior of the mobile device is controlled to accommodate features that are specific to the accessory type.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. patent applicationSer. No. 14/933,090, the contents of which are hereby incorporated byreference.

TECHNICAL FIELD

The present disclosure relates to mobile devices and, in particular, tomethods for using a mobile device with accessories.

BACKGROUND

Mobile device users often purchase accessories, such as cases, coversand holsters, to protect their mobile devices. Mobile devices arevulnerable to physical damage, as they may be dropped or bumped againstsurfaces during use, resulting in broken and/or scratched screens,dented edges or damage to internal parts. Cases and covers may be usefulin preventing or mitigating the effects of these types of physicaldamage. Device cases and covers may offer additional benefits, such as:doubling as a stand to prop up a mobile device; providing sleeves and/orpockets for holding other articles; and allowing for improved gripduring use of the mobile device. A device holster may be attached to auser's belt using a clip or loop and allow a mobile device to be carriedaround conveniently and safely.

Manufacturers typically produce many different types of accessories formobile devices, as consumers may have wide ranging preferences withrespect to design, utility features, etc. of accessories for theirmobile device. In particular, various types of cases, covers andholsters for mobile devices are commercially available.

BRIEF DESCRIPTION OF DRAWINGS

Reference will now be made, by way of example, to the accompanyingdrawings which show example embodiments of the present application andin which:

FIGS. 1A and 1B show a front view and a rear view, respectively, of anexample mobile device.

FIG. 1C is a block diagram illustrating an example mobile device inaccordance with example embodiments of the present disclosure.

FIG. 2 shows a perspective view of an example protective cover for amobile device.

FIG. 3 shows a front view of the inside of the example protective coverof FIG. 2 in an open position, with a mobile device mounted in theprotective cover.

FIG. 4 shows, in flowchart form, an example method for using a mobiledevice with an accessory in accordance with example embodiments of thepresent disclosure.

FIG. 5 shows, in flowchart form, an example method for using a mobiledevice with the example protective cover of FIG. 2 in accordance withexample embodiments of the present disclosure.

FIG. 6 shows, in flowchart form, an example method for using a mobiledevice with an example holster in accordance with example embodiments ofthe present disclosure.

Like reference numerals are used in the drawings to denote like elementsand features.

DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS

In one aspect, the present disclosure describes a method for using amobile device with an accessory. The mobile device causes at least onecamera associated with the mobile device to capture one or more imagesof a pattern disposed on a surface of an accessory that is being usedwith the mobile device. A code associated with the accessory isidentified from the one or more captured images of the pattern and atype associated with the accessory is determined based on the identifiedcode. The mobile device enters an accessory-specific operating mode inwhich the behavior of the mobile device is controlled to accommodatefeatures that are specific to the determined accessory type.

In another aspect, the present disclosure describes a mobile device thatis suitable for use with an accessory. The mobile device includes amemory, at least one camera and a display on a front surface of themobile device. The mobile device also includes a processor that iscoupled to the memory, the at least one camera and the display. Theprocessor is configured to cause the at least one camera of the mobiledevice to capture one or more images of a pattern disposed on a surfaceof an accessory that is being used with the mobile device. A codeassociated with the accessory is identified by the processor from theone or more captured images of the pattern and a type associated withthe accessory is determined by the processor based on the identifiedcode. The processor of the mobile device enters an accessory-specificoperating mode in which the behavior of the mobile device is controlledto accommodate features that are specific to the determined accessorytype.

Other example embodiments of the present disclosure will be apparent tothose of ordinary skill in the art from a review of the followingdetailed descriptions in conjunction with the drawings.

The present disclosure describes methods for using a mobile device withaccessories that are designed for the mobile device. The accessoriesinclude features that allow a mobile device being used with theaccessories to identify, among others, a type associated with theaccessories. By determining the type and/or other properties associatedwith the accessories, the mobile device may be able to customize devicebehavior to suit the accessories being used. In particular, differentmobile devices may be used with a single accessory, each mobile deviceadjusting their behavior to adapt to the features that are specific tothe accessory.

Example Mobile Device

Reference is first made to FIGS. 1A and 1B, which show a front view anda rear view, respectively, of an electronic device which is, in theexample, a mobile device 100. The mobile device 100 can be a mobilephone, portable computer, smartphone, tablet computer, personal digitalassistant, wearable computer such as a watch, a television, a digitalcamera or a computer system, for example. The mobile device 100 may beof a form different from those specifically listed above.

FIG. 1A illustrates a front surface 102 of the mobile device 100. Thefront surface 102 is a side of the mobile device 100 which includes adisplay 104 that is configured to be viewed by a user of the mobiledevice 100. The display 104 may be a touchscreen display which acts asboth an input interface (i.e. touch-sensitive overlay) and an outputinterface (i.e. display). The display 104 may be constructed using atouch-sensitive input surface which is connected to an electroniccontroller and which overlays the display 104. The touch-sensitiveoverlay and the electronic controller provide a touch-sensitive inputinterface and a processor of the mobile device 100 interacts with thetouch-sensitive overlay via the electronic controller.

FIG. 1B illustrates a rear surface 112 of the mobile device 100. Therear surface 112 is a side of the mobile device 100 which does notinclude the main display 104. In the embodiment illustrated, the rearsurface 112 is a side of the mobile device 100 which is opposite to thefront surface 102 (FIG. 1A) of the mobile device 100. That is, the rearsurface 112 may be substantially parallel to the front surface 102 ofthe mobile device 100.

The mobile device 100 includes one or more cameras 153. The cameras 153are configured to generate camera data, such as images in the form ofstill photographs and/or motion video. The camera data may be capturedin the form of an electronic signal which is produced by an image sensorassociated with the camera 153. More particularly, the image sensor (notshown) is configured to produce an electronic signal in dependence onreceived light. That is, the image sensor converts an optical image intoan electronic signal, which may be output from the image sensor by wayof one or more electrical connectors associated with the image sensor.The electronic signal represents electronic image data (which may alsobe referred to as camera data).

In the embodiment illustrated, the front surface 102 includes a frontfacing camera 106. A front facing camera is a camera which is located toobtain images of a subject near the front surface 102 of the mobiledevice 100. That is, the front facing camera 106 may be generallylocated at or near the front surface 102 of the mobile device 100. Thefront facing camera 106 may be located anywhere on the front surface102; for example, the front facing camera 106 may be located above orbelow the display 104. In at least some embodiments, the front facingcamera 106 may be provided in a central location relative to the display104, to facilitate image acquisition of a face. The front facing camera106 may be used, for example, to allow a user of the mobile device 100to engage in a video-based chat with a user of another mobile device orto capture images of the user's own face. In some embodiments, the frontfacing camera 106 is mounted internally within a housing of the mobiledevice 100, beneath a region of the front surface 102 which transmitslight. For example, the front facing camera 106 may be mounted beneath aclear portion of the housing of the mobile device 100 which allows lightto be transmitted to the internally mounted front facing camera 106.

Similarly, the rear surface 112 includes a rear facing camera 116. Arear facing camera 116 is a camera 153 which is located to obtain imagesof a subject near the rear surface 112 of the mobile device. That is,the rear facing camera may be located on or near the rear surface 112 ofthe mobile device 100. For example, the rear facing camera 116 may bemounted internally within a housing of the mobile device 100 beneath aregion of the rear surface 112 which transmits light.

In at least some embodiments (not shown), the mobile device 100 mayinclude both a front facing camera and a rear facing camera. The rearfacing camera may obtain images which are not within the field of viewof the front facing camera. The fields of view of the front facing andrear facing cameras may generally be in opposing directions.

The mobile device 100 may also have additional camera hardware tocomplement the cameras 153. For example, in the embodiment illustrated,the mobile device 100 includes a flash 155. The flash may, in someembodiments, be a light emitting diode (LED) flash. The flash 155 emitselectromagnetic radiation and may be used to produce a brief brightlight to facilitate picture-taking in low light conditions. Inparticular, the flash 155 may emit light while an image is capturedusing the camera 153. In FIG. 1B, the flash 155 is located to emit lightat the rear surface 112 of the mobile device 100. That is, the flash isa rear facing flash in the illustrated embodiment. The mobile device 100may include a front facing flash instead of or in addition to the rearfacing flash to emit light at the front surface 102 of the mobile device100.

Reference is now made to FIG. 1C which illustrates a block diagram ofcomponents of the mobile device 100.

The mobile device 100 includes a controller including at least oneprocessor 140 (such as a microprocessor) which controls the overalloperation of the mobile device 100. The processor 140 may becommunicatively coupled with device subsystems such as one or moreoutput interfaces (such as a display 104, a flash 155 and/or a speaker),one or more input interfaces (such as a camera 153, control buttons (notshown), a touch-sensitive overlay (not shown) associated with atouchscreen display and/or other input interfaces), memory (such asflash memory 144, random access memory (RAM) 146, read only memory (ROM)148, etc.).

The mobile device 100 stores data 125 in an erasable persistent memory,which in one example embodiment is the flash memory 144. In someembodiments, the data 125 includes images generated by the camera 153.

The processor 140 operates under stored program control and executesprocessor-executable instructions 120 stored in memory such aspersistent memory, for example, in the flash memory 144.

The processor-executable instructions 120 or parts thereof may betemporarily loaded into volatile memory such as the RAM 146. The RAM 146may be used for storing runtime data variables and other types of dataor information, as will be apparent. Although specific functions aredescribed for various types of memory, this is merely one example. Itwill be appreciated that a different assignment of functions to types ofmemory could also be used.

The processor 140 may be communicatively coupled to the camera 153 toallow the processor 140 to receive electronic signals representingcamera data from the camera 153. The processor 140 may also becommunicatively coupled to the flash 155 to allow the processor 140 tocontrol the flash 155.

In at least some embodiments, the processor-executable instructions mayinclude one or more camera applications 180 or software modules whichare configured to control the camera 153 and the flash 155. The cameraapplication 180 may, for example, be configured to provide a viewfinderon the display 104 by displaying, in real time or near real time, imagesdefined in the electronic signals received from the camera 153. Thecamera application 180 may be configured to store the images or videosto memory, for example the flash memory 144. The images may be stored invarious formats including JPEG, RAW, BMP, etc. The camera application180 may be configured to receive data from one or more image and/orfocus sensors of the camera 153 for use with autofocus methods asdescribed herein.

The camera application 180 may, in various embodiments, determine and/orcontrol any one or more of a number of various camera related features,options or settings including, for example, the flash 155, a digitalzoom feature (which may crop an image to a centered area with the sameaspect ratio as the original), an image stabilization feature, a shutterspeed, a camera lens aperture, a focal length, high dynamic rangesettings such as a long exposure time and a short exposure time, a whitebalance setting and other camera configuration settings. In someembodiments, the focal length may be adjusted by lens movement. Lensmovement contributes to focusing a scene or object onto an image sensor.Some of the features may be automatically determined by the cameraapplication 180. That is, at least some of these settings may bedetermined without direct user input setting such settings.

While the embodiment discussed above includes a processor 140 coupledwith a camera application 153 which collectively act as an image signalprocessor to provide image related functions, in other exampleembodiments (not shown), another processor such as a dedicated imagesignal processor, may provide some or all of these functions. That is,an image signal processor may be configured to perform the functions ofthe camera application 180 or a portion thereof.

For example, the camera 153 may be a digital camera provided in anintegrated circuit (IC) having a memory such as Electrically ErasableProgrammable Read-Only Memory (EEPROM) or flash memory,analog-to-digital (A/D) converter and a controller such as a suitablyprogrammed microprocessor or Field Programmable Gate Array (FPGA). TheIC may provide an industry standard interface such as a SerialPeripheral Interface (SPI) or Inter-Integrated Circuit (I2C) interfacefor connecting to a printed circuit board (PCB) of the mobile device100. The controller provided on the IC may be configured to perform someor all of the features of the methods described herein.

Furthermore, while the camera application 180 has been illustrated as astand-alone application, in at least some example embodiments, thefunctions of the camera application 180 may be provided by a pluralityof software modules. In at least some example embodiments, the softwaremodules may be divided among multiple applications.

Further, while the memory which stores the processor-executableinstructions 120 has been illustrated using a block that is separatefrom the processor 140, in practice, the memory storing theprocessor-executable instructions 120 may be provided on-board theprocessor 140. That is, the processor 140 may include internal memoryand the processor-executable instructions may be provided on theinternal memory.

The mobile device 100 may include other components apart from thoseillustrated in FIG. 1C. By way of example, the mobile device 100 mayinclude or be connected to a power source, such as a battery, whichprovides power to various components of the electronic device.

Example Protective Cover for a Mobile Device

Reference is made to FIG. 2, which shows a perspective view of anaccessory. In the example, the accessory is a protective cover 200 forencasing a mobile device such as the mobile device 100 of FIGS. 1A to1C. The protective cover 200 can provide physical protection for themobile device and prevent or mitigate any potential damage resultingfrom unwanted contact with other surfaces and/or objects. In at leastsome embodiments, the protective cover 200 may be configured to encasethe mobile device in an interior space created by the protective cover200 in a closed position. In particular, the protective cover 200 may besized and shaped dimensionally to cover at least portions of the frontand rear surfaces of the mobile device in the closed position. Forexample, the protective cover 200 may cover all or substantially all ofthe rear surface of the mobile device as well as portions of a displayon the front surface of the mobile device. The protective cover 200 mayalso cover parts of one or more lateral edges of the mobile device inthe closed position. The closed position of the protective cover 200will be described in greater detail below.

The protective cover 200 may be constructed from various different typesof materials. For example, materials such as leather, hard rubber,plastic, silicone, fiber, fabric and metal may be used in making theprotective cover 200. In at least some embodiments, different parts ofthe protective cover 200 may be constructed using different materials.For example, a back cover associated with the protective cover 200 mayhave a body composed of a combination of leather and plastic while afront cover of the protective cover 200 may be made from a durablefabric (e.g. canvas).

In at least some embodiments, the protective cover 200 may define aplurality of apertures on the body of the protective cover 200. Thelocations and sizes of the apertures may correspond to those of a numberof external components of the mobile device when the mobile device ismounted in the protective cover 200, such components including a frontfacing camera, a rear facing camera, a flash lens, a speaker, amicrophone and any physical function buttons. The apertures mayaccommodate use of functional features of a mobile device when themobile device is mounted in the protective cover 200, eliminating theneed to physically remove the mobile device from the protective cover200 before use.

Reference is now made to FIG. 3, which shows a front view of the insideof the protective cover 200 in an open position, with mobile device 100mounted in the protective cover 200. The protective cover 200 includes aback cover 302. The back cover 302 is configured to cover the rearsurface of a mobile device that is mounted in the protective cover 200.A first side 304 represents the inside of the back cover 302. Inparticular, the mobile device 100 is mounted on the first side 304 ofthe back cover 302 and the first side 304 supports the rear surface ofthe mobile device 100. In at least some embodiments, the first side 304accommodates the shape of the rear surface of the mobile device 100. Forexample, the rear surface of the mobile device 100 may be generally flator curved, and may sometimes have a number of protrusions and/or curvededges. The first side 304 of the back cover 302 may be shaped to fitover the rear surface of the mobile device 100 and conform to the shapeof the rear surface.

The back cover 302 may be configured to fixedly secure the mobile device100 to the back cover 302 when the mobile device 100 is mounted on thefirst side 304 of the back cover 302. In at least some embodiments, theback cover 302 may include a plurality of side walls extending from thefirst side 304 of the back cover 302. The side walls extend generallyperpendicular to a plane of the back cover 302. The side walls mayextend along the entire outer perimeter of the back cover 302 or alongonly portions of the perimeter. For example, a plurality of side wallsmay join to form at least four corner sections along the outer perimeterof the back cover 302. The inner surfaces of the side walls and thesurface of the first side 304 define a recess configured to receive themobile device 100 when the mobile device 100 is mounted on the backcover 302. In particular, the side walls may ensure that the mobiledevice 100 is retained in a fixed position in the recess defined by theinner surfaces of the side walls and the surface of the first side 304,by bringing the mobile device 100 into frictional contact with the innersurfaces of the side walls. The side walls may be constructed from ahard material, such as metal or polyurethane plastic, or a flexible,malleable material such as rubber or silicone.

Other techniques for securing the mobile device 100 to the back cover302 of the protective cover 200 may be available. For example, in someembodiments, various adhesives may be used to attach the mobile device100 to the first side 304 of the back cover 302. As a further example,the rear surface of the mobile device 100 may define a plurality ofgrooves and the first side 304 may include protrusions corresponding tothe grooves, the protrusions being shaped to fit and be retained in thegrooves.

The protective cover 200 also includes a front cover 303. The frontcover 303 is configured to cover the front surface of a mobile devicewhen the mobile device 100 is mounted on the back cover 302 of theprotective cover 200. The front cover 303 includes a first side 307,which represents the inside of the front cover 303. The front cover 303is hingedly connected to the back cover 302. More specifically, in atleast some embodiments, the protective cover 200 may include a spine 305which connects the front cover 303 and the back cover 302. The spine 305may be attached to a first edge of the front cover 303 and a first edgeof the back cover 302, the first edge of the front cover 303 beingproximal to the first edge of the back cover 302 when the protectivecover 200 is in an open position. The spine 305 allows hinged movementof the front cover 303 relative to the back cover 302. In particular,the front cover 303 may be folded relative to the back cover 302 suchthat the first side 307 of the front cover 303 is generally parallel toand faced towards the first side 304 of the back cover 302 in a closedposition of the protective cover 200. The spine 305 may enable flexiblehinged movement of the front cover 303 relative to the back cover 302corresponding to, for example, varying degrees of opening (i.e. angledpositions of the front cover 303 relative to the back cover 302) of theprotective cover 200. The spine 305 may extend along the entire lengthsof the respective edges of the front cover 303 and back cover 302 oronly partially along the edges. In some other embodiments, the frontcover 303 may be connected to the back cover 302 as a side flap that ishingedly attached to the back cover 302. For example, the front cover303 may comprise a panel configured to be folded over the first side 304of the back cover 302.

In at least some embodiments, the front cover 303 may include one ormore sleeves (not shown) on the first side 307 for holding numerousdifferent articles. For example, the sleeves of the front cover 303 maybe configured to contain notes or payment cards on the inside of theprotective cover 200. Furthermore, in some embodiments, at least aportion of the front cover 303 may be transparent or translucent.

The front cover 303 is hingedly connected to the back cover 302 suchthat the front cover 303 can be folded relative to the back cover 302 toenclose the mobile device 100 between the front cover 303 and the backcover 302 when the protective cover 200 is in a closed position. Inparticular, in the closed position, the front cover 303 may rest on thefront surface of the mobile device 100 when the mobile device 100 ismounted on the back cover 302 such that the first side 307 is adjacentto the front surface of the mobile device.

In the example of FIG. 3, one or more apertures 322 are defined on thebody of the front cover 303. The apertures 322 extend between the firstside 307 and an external surface of the front cover 303. In at leastsome embodiments, the apertures 322 allow at least a portion of thefront surface of a mobile device mounted in the protective cover 200 tobe visible when the protective cover 200 is in the closed position. Inparticular, a user of a mobile device that is mounted in the protectivecover 200 may be able to view portions of a display 104 on the frontsurface of the mobile device when the protective cover 200 is closed. Insome cases, the protective cover 200 may include one or more transparenttouchscreens or windows that are sized to be retained in the apertures322 defined on the front cover 303. For example, the touch-screens mayaccommodate capacitive sensing and conduct any detected touches to thedisplay of the mobile device when the protective cover 200 is in theclosed position.

The front cover 303 includes a pattern 324 that is disposed on the firstside 307. The pattern 324 is located on the first side 307 such that atleast a portion of the pattern 324 aligns with a front facing camera 106of the mobile device 100 when the protective cover 200 is in the closedposition. In at least some embodiments, the pattern 324 may bepositioned on the first side 307 such that the pattern 324 is locatedwithin the field of view of the front facing camera 106 in the closedposition. In particular, the position of the pattern 324 facilitatescapturing an image of the pattern 324 by the front facing camera 106 ofthe mobile device 100. For example, in the example of FIG. 3, the frontfacing camera 106 is located above the display on the front surface 102of the mobile device 100. The front cover 303 of the protective cover200 defines an aperture 322 through which a portion of the display ofthe mobile device can be viewed, and the pattern 324 is located abovethe aperture 322 on the first side 307 of the front cover 303.

Since the location of the front facing camera may vary across differentdevices, the pattern 324 may be repeated on the first side 307 of thefront cover 303. Many smartphones and tablet computers are designed toinclude a front facing camera above a display screen on the frontsurface. The pattern 324 may be positioned at a plurality of differentlocations near the top edge of the front cover 303 such that an image ofthe pattern 324 may be captured by a front facing camera on multipledifferent mobile devices. For example, the pattern 324 may be repeatedhorizontally in a periodic manner on the first side 307 of the frontcover 303, each location of the pattern 324 being in spaced relation toan adjacent location of the pattern 324.

The pattern 324 may encode various different types of information aboutthe protective cover 200. In at least some embodiments, the pattern 324may encode information regarding a type associated with the protectivecover 200. For example, the pattern 324 may correspond to a codeindicating whether the protective cover 200 is of a type of protectivecover having a windowed aperture on the front cover for viewing portionsof the display of an encased mobile device. As another example, thepattern 324 may be a code indicating whether the protective cover iscompatible with other accessories for a mobile device, such as aportable stand or wireless charging pad.

In some embodiments, the code represented in the pattern 324 mayindicate one or more physical properties associated with the front cover303. As explained above, the front cover 303 may define a plurality ofapertures through which portions of the front surface of a mountedmobile device are visible. In particular, portions of the display of themobile device may be viewed through one or more apertures on the frontcover 303. Rather than turning off the display 104 of the mobile device100 entirely when the protective cover 200 is in a closed position, itmay be desirable to display information on portions of the display 104that align with apertures 322 of the front cover 303 in the closedposition. By way of example, even when the protective cover 200 isclosed, encasing a mobile device between the front cover 303 and theback cover 302, a user of the mobile device may wish to be able to viewcertain information, such as the current time, newly receivednotifications, calendar event reminders, etc., through the apertures 322on the front cover 303. On the other hand, however, presenting a displayof information on the entire display of the mobile device when theprotective cover 200 is in the closed position would result in unwantedconsumption of battery power. As the display of information on thedisplay is controlled by the mobile device, in order to limit thedisplay of information only to those portions of the display that areviewable through the apertures 322 in the closed position of theprotective cover 200, it may be useful to specify to the processor ofthe mobile device certain physical properties associated with theapertures 322.

The use of a pattern 324 may be one possible way of indicating to themobile device one or more physical properties associated with theaperture 322 on the front cover 303. For example, the pattern 324 mayencode information regarding the location, size, shape or orientation ofany of the apertures 322. In particular, the information relating to thelocation, size, etc. of the apertures 322 may be specified relative tothe dimensions of a mobile device that is configured to be fixedlysecured to the back cover 302 of the protective cover 200. For example,the location and size information for the apertures 322 may be describedrelative to the dimensions of a mobile device that can fit inside and beretained in a recess defined by side walls and the first side 304 of theback cover 302.

In at least some embodiments, the pattern 324 may be an alphanumericcode. In some other embodiments, the pattern 324 may include a barcode.For example, the pattern 324 may be a two-dimensional or matrix barcode,such as a Quick Response (QR) code. In yet further embodiments, thepattern 324 may include one or more distinct shapes. In some cases, thepattern 324 may be machine-readable only and invisible to the human eye.Additionally, the pattern may comprise one or more apertures positionedin a predetermined area on the first side 307 of the front cover 303.Other variations of the pattern 324 may be used for the protective cover200.

The protective cover 200 may be configured to facilitate capturingimages of the pattern 324 by a front facing camera of a mobile devicethat is mounted in the protective cover 200. For example, in someembodiments, the side walls may be of such height as to support thefront cover 303 and maintain the first side 307 of the front cover 303in spaced relation from the front surface of the mobile device 100 whenthe protective cover 200 is in the closed position. In particular, theheight of the side walls may be greater than the height (i.e. thickness)of a mobile device mounted in the protective cover 200. The spacebetween the front surface of the mobile device 100 and the first side307 of the front cover 303 may ensure that an image can be captured bythe front facing camera 106.

Additionally, in some embodiments, the front cover 303 may define one ormore light-transmitting apertures near or on a portion of the frontcover 303 on which the pattern 324 is disposed, in order to let insufficient amount of light for the front facing camera 106 of the mobiledevice 100 to be able to capture an image of the pattern 324. In someembodiments, the one or more light-transmitting apertures may be definedin the vicinity of the pattern 324 on the front cover 303 and/or on aportion of the front cover 303 that aligns directly with the frontfacing camera 106 of the mobile device 100 in the closed position. Forexample, the light-transmitting apertures may be defined on the frontcover 303 within 1 centimeter of the pattern 324.

In at least some embodiments, the protective cover 200 may include alabel 326 which is attached to the first side 307 of the front cover303. In particular, a first side of the label 326 may be affixed to thefirst side 307 of the front cover 303. The second side 328 of the label326 may contain the pattern 324. That is, the position of the label 326on the first side 307 is such that at least a portion of the pattern324, disposed on the second side 328 of the label 326, aligns with thefront facing camera 106 of the mobile device 100 when the mobile device100 is mounted in the protective cover 200 is in the closed position.

The pattern 324 itself may facilitate image capture by the front facingcamera 106 in the closed position. In at least some embodiments, thepattern 324 may be printed using colors that are easily detectable inimages even in low light settings. For example, the colors of the inkused for the pattern 324 may be selected as to contrast starkly with thecolors of the second side 328 of the label 326 and/or the first side 307of the front cover 303. In some cases, the pattern 324 may be printedusing fluorescent colored ink.

Method for Using a Mobile Device with an Accessory

Reference is now made to FIG. 4, which shows, in flowchart form, anexample method 400 for using a mobile device with an accessory. In atleast some embodiments, the method 400 may be performed by a processorof the mobile device. In particular, in some embodiments,processor-executable instructions 120, such as the camera application180, may configure the processor to perform the method 400. Theaccessory may be a case or cover designed to attach to, support or holdthe mobile device. For example, the accessory may be a shell, holster,pouch or sleeve sized to contain the mobile device and provide a measureof protection for the mobile device. As another example, the accessorymay be a protective cover of the type described above with reference toFIGS. 2 and 3. In some embodiments, the method 400 may be performed withother types of accessories such as, for example, portable stands orcharging pads.

In operation 402, the mobile device causes a camera on the mobile deviceto capture one or more images of a pattern disposed on a surface of theaccessory. The mobile device may have both a front facing camera and arear facing camera and, so, the images of the pattern may be capturedusing one or both of the cameras. In at least some embodiments, the oneor more cameras of the mobile device may capture images of the patternupon detecting that a predetermined condition is satisfied. By way ofexample, the cameras may be activated to begin capturing images afterthe mobile device detects that it is in a predefined physical positionwith respect to the accessory. For example, in response to detectingthat the mobile device is partially or completely encased in theaccessory, the mobile device may cause the cameras to start capturingimages. As another example, the cameras may be activated when the mobiledevice detects that the accessory is within a certain proximity of themobile device or that the accessory and the mobile device are inphysical contact with each other.

Once the images of the pattern are obtained by the mobile device, inoperation 404, a code associated with the accessory may be identifiedfrom the images. The identified code may encode various detailsregarding the accessory such as physical features, type, model, etc. Inparticular, in operation 406, the mobile device determines a typeassociated with the accessory based on the identified code. The “type”associated with an accessory may refer to the identity of the accessoryitself (e.g. whether the accessory is a case, shell, holster, etc.) ormay specify certain properties about the accessory. For example, the“type” may identify one or more properties that are unique to a specificaccessory. The mobile device may therefore be able to distinguishbetween different types of accessories as well as between differentmodels/versions/sizes/etc. of the same type of accessory for the mobiledevice, based on analyzing the code identified from the images of thepattern.

In at least some embodiments, the mobile device may, at operation 406,access a database containing listings of a plurality of codes associatedwith various different accessories and the “types” corresponding to thecodes. For example, the database may include all of the codes associatedwith accessories that are known to be designed and manufactured for themobile device. By comparing the code identified from the images of thepattern to codes found in the database, the mobile device may be able todetermine the type associated with the accessory.

When the type associated with the accessory is determined, the mobiledevice enters an accessory-specific operating mode, in operation 408. Inthe accessory-specific operating mode, the behavior of the mobile devicemay be controlled to accommodate features that are specific to thedetermined accessory type. That is, according to method 400, evenwithout an explicit instruction from a user of the mobile device, themobile device may automatically enter a mode in which its behavioradjusts to facilitate use with a specific accessory. Theaccessory-specific operating mode may cause various different changes tobe effected to the behavior of the mobile device. For example, thechanges in device behavior may relate to display of information on themobile device, battery power consumption level, notification settings,etc. Examples of accessory-specific operating mode will be provided ingreater detail below.

Reference is now made to FIG. 5, which shows, in flowchart form, anexample method 500 for using a mobile device with a protective cover. Inat least some embodiments, the method 500 may be performed by aprocessor of the mobile device. For example, the method 500 may beperformed by a mobile device that is suitable for use with a protectivecover such as the protective cover 200 of FIGS. 2 and 3. In particular,in some embodiments, processor-executable instructions 120, such as thecamera application 180, may configure the processor of the mobile deviceto perform the method 500.

The mobile device may first detect that a protective cover covering atleast portions of the mobile device is in a closed position. Asexplained above, the closed position of a protective cover correspondsto a position in which the inside of the front cover is generallyparallel to and faced opposite the inside cover of the back cover of theprotective cover. When the mobile device is mounted on and secured tothe back cover, the front cover may lie directly over the mobile device,with the inside of the front cover being adjacent to the front surfaceof the mobile device.

The detection of a closed position of the protective cover may beachieved in a number of different ways. For example, the mobile devicemay employ a proximity detection technique for determining whether theprotective cover is closed. The mobile device may include a proximitydetection subsystem comprising at least one electromagnetic radiation(EMR) source and at least one EMR detector, the source and the detectorboth being coupled to the processor of the mobile device. The proximitydetection subsystem may be controlled by one or a combination of amonitoring circuit, a control circuit and operating software of themobile device. The EMR source can be configured to emit EMR from themobile device and the EMR detector may detect incident EMR to generateand output an electrical signal representative of the detected EMR. TheEMR source and the EMR detector may be positioned on the front surfaceof the mobile device such that EMR emitted from the mobile device may bereflected by objects within close proximity of the front surface backtowards the EMR detector. The mobile device may interpret the detectedEMR patterns and the timing of these patterns to determine a distance ofan object from which the EMR signals were reflected. In particular, whenthe protective cover is approaching a closed position (i.e. as the frontcover is being closed over the mobile device), the distance between thefront surface of the mobile device and the front cover of the protectivecover will gradually decrease until reaching a minimum in the closedposition. Accordingly, the mobile device may determine that theprotective cover is in the closed position based on readings from theproximity detection subsystem and the changes in distance inferredbetween the mobile device and the front cover.

In some embodiments, the mobile device may include an ambient lightsensor near or on the front surface of the mobile device. The ambientlight sensor may be used for enabling automatic control of displaybacklight brightness over a wide range of lighting conditions. That is,depending on the ambient lighting conditions, the brightness of thedisplay may be increased or decreased, to improve visibility and/orreduce power consumption. When the protective cover is in or approachingthe closed position, the ambient light sensor of the mobile device maydetect low light level since the front cover is gradually brought overto cover the light sensor. Therefore, sensor readings corresponding tovery low ambient light levels may indicate to the mobile device that theprotective cover is in a closed position.

In some other embodiments, the mobile device may additionally include aHall Effect sensor that is configured for proximity switching,positioning and speed detection based on changes to a magnetic fieldnear the mobile device. A Hall Effect sensor is a transducer that canvary an output voltage in response to an ambient magnetic field. If thefront cover of the protective cover encasing the mobile device includesan embedded magnet, the Hall Effect sensor of the mobile device may beable to detect the proximity of the magnet as the front cover is closedand the protective cover approaches a closed position.

Upon determining that the protective cover is in or approaching theclosed position, the mobile device may cause the front facing camera onthe front surface of the mobile device to capture one or more images.That is, in operation 502, the front facing camera of the mobile devicemay obtain images of the pattern disposed on the inside of the frontcover of the protective cover. In at least some embodiments, the frontfacing camera may be activated as the front cover is being closed inorder to capture a sequence images during a closing movement of thefront cover. Greater amount of light may reach the front surface of themobile device during the closing movement of the front cover as comparedto when the protective cover is in a completely closed position and, so,the capture of images prior to the protective cover reaching a closedposition may facilitate acquiring clearer images of the pattern on thefront cover. In some embodiments, the front facing camera of the mobiledevice may capture images at regular intervals of time, which may allowthe mobile device to determine whether the protective cover ismaintained in a closed position. For example, the front facing cameramay be configured to obtain camera data at predetermined time intervalsafter the first time of detecting that the protective cover is in theclosed position.

In operation 504, the mobile device analyzes the acquired images of thepattern to identify a code associated with the protective cover. The oneor more images of the pattern may depict the entirety of the code or asubstantial portion of the code to enable identification of the code.That is, the portions of the code shown in the images of the pattern aresufficient to identify the code associated with the protective cover.

In operation 506, the mobile device determines a type associated withthe protective cover based on the identified code. In particular, in atleast some embodiments, the mobile device may detect one or morephysical properties associated with the front cover of the protectivecover. For example, in at least some embodiments, the mobile device maydetermine that the front cover defines one or more apertures throughwhich at least a portion of the front surface of the mobile device isvisible in the closed position. The apertures may allow a user of themobile device to view portions of a display on the front surface of themobile device when the front cover is closed over the mobile device. Thecode may represent information regarding the one or more aperturesdefined on the front cover, such as shape, shape and location. Otherinformation may also be encoded in or determined from the code,including: orientations of the apertures; whether capacitivetouchscreens or windows are fitted in the apertures; which of theapertures are suitable for displaying only and which are suitable fortouch-based interaction, etc.

In response to determining the type associated with the protectivecover, in operation 508, the mobile device may control a display ofinformation on the display. For example, the mobile device may determinewhether the front cover defines apertures thereon, in operation 510. Ifthe mobile device determines that the front cover does not include anyapertures, when the protective cover is in the closed position, themobile device may turn off the display entirely, in operation 512. Sincea front cover without apertures would not provide visibility of thedisplay, the display may be turned off to save power consumption whilethe protective cover is closed. For example, even if a display time-outperiod has not elapsed since the mobile device was last left idle, upondetermining that there are no apertures on the front cover, the displaymay be turned off at the time the mobile device detects that the frontcover is closed. If, on the other hand, the mobile device determinesthat the front cover does include one or more apertures, the mobiledevice may cause a display information on only those portions of thedisplay that align with the apertures of the front cover when theprotective cover is in the closed position, in operation 514. Inparticular, the portions of the display aligning with the apertures ofthe front cover when the front cover is closed may contain a display ofinformation while the remainder of the display may be turned off. Forexample, when the protective cover is closed, graphical user interfacesassociated with various notifications, reminders or other information(e.g. current time/date, weather, device status such as remainingbattery level and wireless connectivity, etc.) may be displayed on theportions of the display that align with the one or more apertures on thefront cover. Such displaying may allow a user of the mobile device toview relevant information through the apertures on the front cover evenwhen the protective cover is closed, while also providing the benefitsof reduced consumption of battery power by cutting back the use ofcovered portions of the display.

Reference is now made to FIG. 6, which shows, in flowchart form, anexample method 600 for using a mobile device with an example holster. Inat least some embodiments, the method 600 may be performed by aprocessor of the mobile device. For example, the method 600 may beperformed by a mobile device that is suitable for use with a holster. Inparticular, in some embodiments, processor-executable instructions 120,such as the camera application 180, may configure the processor of themobile device to perform the method 600.

A holster for a mobile device is a case for carrying the mobile device.In at least some embodiments, a holster may include a belt with loops orslots for carrying the mobile device. The holster has a first innersurface and a second inner surface. When the mobile device is insertedin the holster, the front and rear surfaces of the mobile device may bein physical contact with the first inner surface and the second innersurface. In operation 602, one or both of front facing camera and a rearfacing camera of the mobile device may be used to capture images of apattern on one of the inside surfaces of the holster. More specifically,in at least some embodiments, a pattern may be disposed on the firstinner surface of the holster such that at least a portion of the patternaligns with the front facing camera when the mobile device is fullyinserted in the holster, allowing images of the pattern to be capturedby the front facing camera. Similarly, in some embodiments, a patternmay be disposed on the second inner surface such that at least a portionof the pattern aligns with the rear facing camera when the mobile deviceis fully inserted in the holster, and the rear facing camera may captureimages of the pattern.

Just as in method 400, the mobile device identifies a code associatedwith the holster from the captured images of the pattern in operation604. Once the code is identified, the mobile device determines, inoperation 606, that the accessory is a holster and/or determines a typeassociated with the holster based on the identified code. The mobiledevice controls device behavior to accommodate features of thedetermined type of holster, in operation 608. For example, in at leastsome embodiments, the mobile device may turn off all or parts of itsdisplay and/or be put in a power saving mode in operation 608.

As noted above, images of a pattern on surfaces of an accessory may beused for identifying a type associated with the accessory. In someembodiments, as previously mentioned, the pattern may be represented asone or more apertures on a surface of the accessory. For example,variations in size, number and positioning of one or more apertures on asurface may be used as a pattern for uniquely identifying an accessoryand/or a type associated with an accessory.

The various embodiments presented above are merely examples and are inno way meant to limit the scope of this application. Variations of theinnovations described herein will be apparent to persons of ordinaryskill in the art, such variations being within the intended scope of thepresent application. In particular, features from one or more of theabove-described example embodiments may be selected to createalternative example embodiments including a sub-combination of featureswhich may not be explicitly described above. In addition, features fromone or more of the above-described example embodiments may be selectedand combined to create alternative example embodiments including acombination of features which may not be explicitly described above.Features suitable for such combinations and sub-combinations would bereadily apparent to persons skilled in the art upon review of thepresent application as a whole. The subject matter described herein andin the recited claims intends to cover and embrace all suitable changesin technology.

The invention claimed is:
 1. A method implemented by a processor of amobile device, the mobile device having at least one camera and adisplay on a front surface of the mobile device, the method comprising:causing the at least one camera to capture one or more images of apattern on an accessory that is being used with the mobile device;determining a type associated with the accessory based on the patternfrom the one or more images; and entering an accessory-specificoperating mode in which behavior of the mobile device is controlled toaccommodate features that are specific to the determined accessory type.2. The method of claim 1, wherein the accessory is a protective coverfor the mobile device, the protective cover having a front cover thatcovers a front surface of the mobile device when the protective cover isin a closed position.
 3. The method of claim 2, wherein the at least onecamera is a front facing camera of the mobile device and wherein thepattern is disposed on a first side of the front cover such that atleast a portion of the pattern aligns with the front facing camera whenthe protective cover is in the closed position, the first side beingadjacent to the front surface of the mobile device in the closedposition.
 4. The method of claim 3, wherein determining a typeassociated with the accessory based on the one or more images comprisesdetermining that the front cover defines one or more apertures throughwhich at least a portion of the front surface of the mobile device isvisible in the closed position.
 5. The method of claim 4, whereindetermining that the front cover defines one or more apertures comprisesdetermining at least one of a size, a shape and a location associatedwith each of the one or more apertures on the front cover.
 6. The methodof claim 4, wherein entering the accessory-specific operating modecomprises displaying information on only those portions of the displaythat align with the one or more apertures of the front cover when theprotective cover is in the closed position.
 7. The method of claim 1,wherein the accessory is a holster for the mobile device, the holsterhaving a first inner surface and a second inner surface.
 8. The methodof claim 7, wherein the at least one camera includes a front facingcamera on a front surface of the mobile device and wherein the patternis disposed on the first inner surface such that at least a portion ofthe pattern aligns with the front facing camera when the mobile deviceis fully inserted in the holster.
 9. The method of claim 7, wherein theat least one camera includes a rear facing camera on a rear surface ofthe mobile device and wherein the pattern is disposed on the secondinner surface such that at least a portion of the pattern aligns withthe rear facing camera when the mobile device is fully inserted in theholster.
 10. The method of claim 1, wherein the pattern comprises atleast one of: a barcode; an alphanumeric code; a shape; and one or moreapertures positioned in a predetermined area on the surface.
 11. Amobile device, comprising: a memory; at least one camera; a display on afront surface of the mobile device; a processor coupled to the memory,the at least one camera and the display, the processor being configuredto: cause the at least one camera to capture one or more images of apattern on an accessory that is being used with the mobile device;determine a type associated with the accessory based on the pattern fromthe one or more images; and enter an accessory-specific operating modein which behavior of the mobile device is controlled to accommodatefeatures that are specific to the determined accessory type.
 12. Themobile device of claim 11, wherein the accessory is a protective coverfor the mobile device, the protective cover having a front cover thatcovers a front surface of the mobile device when the protective cover isin a closed position.
 13. The mobile device of claim 12, wherein the atleast one camera is a front facing camera of the mobile device andwherein the pattern is disposed on a first side of the front cover suchthat at least a portion of the pattern aligns with the front facingcamera when the protective cover is in the closed position, the firstside being adjacent to the front surface of the mobile device in theclosed position.
 14. The mobile device of claim 13, wherein determininga type associated with the accessory based on the one or more imagescomprises determining that the front cover defines one or more aperturesthrough which at least a portion of the front surface of the mobiledevice is visible in the closed position.
 15. The mobile device of claim14, wherein determining that the front cover defines one or moreapertures comprises determining at least one of a size, a shape and alocation associated with each of the one or more apertures on the frontcover.
 16. The mobile device of claim 14, wherein entering theaccessory-specific operating mode comprises displaying information ononly those portions of the display that align with the one or moreapertures of the front cover when the protective cover is in the closedposition.
 17. The mobile device of claim 14, wherein the accessory is aholster for the mobile device, the holster having a first inner surfaceand a second inner surface.
 18. The mobile device of claim 17, whereinthe at least one camera includes a front facing camera on a frontsurface of the mobile device and wherein the pattern is disposed on thefirst inner surface such that at least a portion of the pattern alignswith the front facing camera when the mobile device is fully inserted inthe holster.
 19. The mobile device of claim 17, wherein the at least onecamera includes a rear facing camera on a rear surface of the mobiledevice and wherein the pattern is disposed on the second inner surfacesuch that at least a portion of the pattern aligns with the rear facingcamera when the mobile device is fully inserted in the holster.
 20. Anon-transitory computer-readable medium storing instructions thereonthat, when executed by one or more processors: cause at least one cameraof a mobile device to capture one or more images of a pattern on anaccessory that is being used with the mobile device; cause a processorof the mobile device to determine a type associated with the accessorybased on the pattern from the one or more images; and cause theprocessor to enter an accessory-specific operating mode in whichbehavior of the mobile device is controlled to accommodate features thatare specific to the determined accessory type.